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Your search for ^lossless +compression +data+factorial did not return any results. 
You may want to try an Advanced Search for additional options. 
Please review the Quick Tips below or for more information see the Search Tips . 
Quick Tips 

• Enter your search terms in lower case with a space between the terms. 

sales offices 

You can also enter a full question or concept in plain language. 

Where are the sales offices? 

• Capitalize proper nouns to search for specific people, places; or 
products. ' T 

John Colter, Netscape Navigator 

• Enclose a phrase in double quotes to search for that exact phrase. 

"museum of natural history" "museum of modern art" 

• Narrow your searches by using a + if a search term must appear on a 



museum +art 

• Exclude pages by using a - if a search term must not appear on a page. 

museum -Paris 

Combine these techniques to create a specific search query. The better 
your description of the information you want, the more relevant your 
results will be. 

museum + "natural history" dinosaur -Chicago 
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results will be. 

museum + "natural history" dinosaur -Chicago 
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• Enclose a phrase in double quotes to search for that exact phrase. 
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results will be. 
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1 Energy-aware lossless data compression 
Kenneth C. Barr, Krste Asanovic 

August 2006 ACM Transactions on Computer Systems (TOCS), Volume 24 issue 3 
Publisher: ACM Press 

Full text available: ^ pdf(873.90 KB) Additional Information: full citation , abstract , references , index terms 

Wireless transmission of a single bit can require over 1000 times more energy than a 
single computation. It can therefore be beneficial to perform additional computation to 
reduce the number of bits transmitted. If the energy required to compress data is less 
than the energy required to send it, there is a net energy savings and an increase in 
_ battery life for portable computers. This article presents a study of the energy savings 
possible by losslessly compressing data prior to transmission. A ... 



Keywords: Compression, energy-aware, lossless, low-power, power-aware 



Lossless compression of volume data 
James E. Fowler, Roni Yagel 

October 1994 Proceedings of the 1994 symposium on Volume visualization 
Publisher: ACM Press 

Full text available: * g| pdf(798.03 KB) Additional Information: full citation, citings , index terms 



3 Energy aware lossless data compression , 

Kenneth Barr, Krste Asanovic 

May 2003 Proceedings of the 1st international conference on Mobile systems, 

applications and services MobiSys '03 
Publisher: ACM Press 

Full text available: ^ pdf(299,94 KB) Additional Information: full citation , abstract , references 

Wireless transmission of a bit can require over 1000 times more energy than a single 32- 
bit computation. It would therefore seem desirable to perform significant computation to 
reduce the number of bits transmitted. If the energy required to compress data is less 
than the energy required to send it, there is a net energy savings and consequently, a 
longer battery life for portable computers. This paper reports on the energy of lossless 
data compressors as measured on a StrongARM SA-110 system. W ... 
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4 Lossless compression of computer generated animation frames 
&y Hee Cheol Yun, Brian K. Guenter, Russell M. Mersereau 
s/ October 1997 ACM Transactions on Graphics (TOG), Volume 16 issue 4 
Publisher: ACM Press 

Full text available: fSl pdff5.18 MB) Additional Information: full citation , abstract, references, citings, index 
^ terms , review 

This article presents a new lossless compression algorithm for computer animation image 
sequences. The algorithm uses transformation information available in the animation 
script and. floating point depth and object number information at each pixel to perform 
highly accurate motion prediction with vary low computation. The geometric data (i.e., 
the depth and object number) can either be computed during the original rendering 
process and stored with the image or computed on the fly during com ... 

Keywords: compression, computer animation, computer graphics, motion prediction 



Segmentation-based multilayer diagnosis lossless medical image compression 

Xin Bai, Jesse S. Jin, Dagan Feng 

June 2004 Proceedings of the Pan-Sydney area workshop on Visual information 
processing VIP '05 

Publisher: Australian Computer Society, Inc. 

Full text available: ^ pdf(380.07 KB) Additional Information: full citation , abstract , references , index terms 

Hospital and clinical environments are moving towards computerisation, digitisation and 
centralisation, resulting in prohibitive amounts of digital medical image data. Compression 
techniques are, therefore, essential in archival and communication of medical image. 
Although lossy compression yields much higher compression rates, the medical 
community has relied on lossless compression for legal and clinical reasons. In this paper, 
we propose a segmentation-based multilayer (SML) coding scheme for ... 

Keywords: lossless compression, medical image coding, region-based image processing, 
segmentation 



Performance optimization of wireless local area networks through VLSI data 
compression 

Bongjin Jung, Wayne P. Burleson 

January 1998 Wireless Networks, Volume 4 issue i 

Publisher: Kluwer Academic Publishers 

Full text available: « pdf(664.69 KB) Additional '"formation: full citation, abstract, references, citings, index 

terms 

In contrast to wireline communication, the physical bandwidth of RF wireless 
communication systems is relatively limited and is unlikely to grow significantly in the 
future. Hence it is advantageous to increase the effective bandwidth of communication 
channels at the expense of complex processing at both the sending and receiving entities. 
In this paper we present a real-time, low-area, and low-power VLSI lossless data 
compressor based on the first Lempel-Ziv algorithm (Ziv and Lempel, 1977 ... 
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ln-network processing: Data compression algorithms for energy-constrained devices 
^ in delay tolerant networks 
^ Christopher M. Sadler, Margaret Martonosi 

October 2006 Proceedings of the 4th international conference on Embedded 

networked sensor systems SenSys '06 
Publisher: ACM Press 
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Full text available: ^ pdf(428.25 KB) Additional Information: full citation , abstract , references , index terms 

Sensor networks are fundamentally constrained by the difficulty and energy expense of 
delivering information from sensors to sink. Our work has focused on garnering additional 
significant energy improvements by devising computationally-efficient lossless 
compression algorithms on the source node. These reduce the amount of data that must 
- be passed through the network and to the sink, and thus have energy benefits that are . 
multiplicative with the number of hops the data travels through the networ ... 

Keywords: data compression, energy efficient communications, mobile ad hoc networks, 
wireless sensor networks 



8 Constraints in data mining: SPARTAN: using constrained models for auaranteed- 
error semantic compression 1 
Shivnath Babu, Minos Garofalakis, Rajeev Rastogi 

June 2002 ACM SIGKDD Explorations Newsletter, Volume 4 issue l 
Publisher: ACM Press 

Full text available: ^pdf(259.12 KB) Additional Information: full citation , abstract , references , citings 

While a variety of lossy compression schemes have been developed for certain forms of 
digital data (e.g., images, audio, video), the area of lossy compression techniques for 
arbitrary data tables has been left relatively unexplored. Nevertheless, such techniques 
are clearly motivated by the ever-increasing data collection rates of modern enterprises 
and the need for. effective, guaranteed-quality approximate answers to queries over 
massive relational data sets. In this paper, we propose SPARTAN 

9 Bioinformatics (BIO): MACE: lossless compression and analysis of microarray 
images 

Robert Bierman, Nidhi Maniyar, Charles Parsons, Rahul Singh ■•'« 

April 2006 Proceedings of the 2006 ACM symposium on Applied computing SAC '06 
Publisher: ACM Press 

Full text available: gpdf(517.72 KB) Additional Information: full citation , abstract , references , index terms 

The ubiquity of microarray expression data in state-of-the-art biology has been well 
established. The widespread adoption of this technology coupled with the significant 
volume of image-based experimental data generated per experiment (averaging 40 MB), 
have led to significant challenges in storage and query-retrieval of primary data from 
microarray experiments. Research in the yet nascent area of microarray data- 
compression seeks to address this problem. In this paper/ we propose a conceptually ... 

Keywords: microarray, microarray data analysis, microarray data compression and 
. storage 



10 SPARTAN: a model-based semantic compression system for massive data tables 
Jis^ Shivnath Babu, Minos Garofalakis, Rajeev Rastogi 

▼ May 2001 ACM SIGMOD Record , Proceedings of the 2001 ACM SIGMOD international 
conference on Management of data SIGMOD '01, volume 30 issue 2 
Publisher: ACM Press 

Full text available* IB pdf(240 19 KB) Add ' tlona ' Information: full citation , abstract , references , citings , index 
•TeH^ : terms 

While a variety of lossy compression schemes have been developed for certain forms of 
digital data (e.g., images, audio, video), the area of lossy compression techniques for 
arbitrary data tables has been left relatively unexplored. Nevertheless, such techniques 
are clearly motivated by the ever-increasing data collection rates of modern enterprises 
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and the need for effective, guaranteed-quality approximate answers to queries over 
massive relational data sets. In this paper, we propose SPA ... 

» 

11 Wavelets applied to loseless compression and progressive transmission of floating 
point data in 3-D curvilinear grids 
Aaron Trott, Robert Moorhead, John McGinley 

October 1996 Proceedings of the 7th conference on Visualization '96 
Publisher: IEEE Computer Society Press 
Full text available: fQ Pdf(493.37 KB) 

Additional Information: full citation ; references , citings , index terms 

1 Publisher Site 



12 Lossless image compression using pixel reordering 
Michael Ciavarella, Alistair Moffat 

January 2004 Proceedings of the 27th Australasian conference on Computer science 
Volume 26 ACSC '04 

Publisher: Australian Computer Society, Inc. 

Full text available: |g|pdf(1 33.88 KB) . Additional Information: full citation , abstract , references , index terms 

Lossless image compression techniques typically consider images to be a sequence of 
pixels in row major order. The processing of each pixel consists of two separate 
operations. The first step forms a prediction as to the numeric value of the next pixel. 
Typical predictors involve a linear combination of neighboring pixel values, possibly in 
conjunction with an edge detection heuristic. In the second step, the difference between 
that prediction and the actual value of the next pixel is coded. In ... 

Keywords: Burrows-Wheeler transformation, image compression, pixel reordering 



13 Efficient end to end data exchange using configurable compression 
^ Yair Wiseman, Karsten Schwan, Patrick Widener 

▼ July 2005 ACM SIGOPS Operating Systems Review, volume 39 issue 3 
Publisher: ACM Press 

Full text available: ^ Ddf(10.77 MB) Additional Information: full citation , abstract , references , index terms 

We explore the use of compression methods to improve the middleware-based exchange 
of information in interactive or collaborative distributed applications. In such applications, 
good compression factors must be accompanied by compression speeds suitable for the 
. data transfer rates sustainable across network links. Our approach combines methods 
that continuously monitor current network and processor resources and assess 
compression effectiveness, with techniques that automatically choose suitable ... 

Keywords: communication lines, compression 



14 Optimal prefetching via data compression 
Jfe. Jeffrey Scott Vitter, P. Krishnan 

™ September 1996 Journal of the ACM (JACM), Volume 43 Issue T 
Publisher: ACM Press 

Full text available: fiB pdf(564.53 KB) Additional information: full citation, abstract, references, citings, index 
' "° ! terms , review 

Caching and prefetching are important mechanisms for speeding up access time to data 
on secondary storage. Recent work in competitive online algorithms has uncovered 
several promising new algorithms for caching. In this paper, we apply a form of the 



http://portalacm.org/resd^ 12/14/06 



Results (page 1): +lossless +compression +data 



Page 5 of 7 



competitive philosophy for the first time to the problem of prefetching to develop an 
optimal universal prefetcher in terms of fault rate, with particular applications to large- 
scale databases and hypertext systems. Our prediction algorithms wit ... 

Keywords: Markov source, caching, competitive analysis, data compression, databases, 
fault rate, hypertext, prediction, prefetching, secondary stage, universal prefetcher 



15 Bayesian networks for lossless dataset compression . 
Scott Davies, Andrew Moore 

August 1999 Proceedings of the fifth ACM SIGKDD international conference on 
Knowledge discovery and data mining 

Publisher: ACM Press 

Full text available: ^ pdf(638.07 KB) Additional Information: full citation , references , citings , index terms 



16 High performance visualization of time-varying volume data over a wide-area network 
status 

Kwan-Liu Ma, David M. Camp 

November 2000 Proceedings of the 2000 ACM/IEEE conference on Supercomputing 
(CDROM) 

Publisher: IEEE Computer Society 

Full text available: J |pdf(141.35 KB) Additional Information: full citation, abstract , references , citings , index 
' Publisher Site terms . . 

This paper presents an end-to-end, low-cost solution for visualizing time-varying volume 
data rendered on a parallel computer located at a remote site. Pipelining and„careful 
grouping of processors are used to hide I/O time and to maximize processor utilization. 
Compression is used to significantly cut down the cost of transferring output images from 
the parallel computer to a display device through a wide-area network. This complete 
rendering pipeline makes possible highly efficient rende ... 

Keywords: Keywords: High Performance Computing, Image Compression, Parallel Volume 
Rendering, Pipelining, Remote Visualization, Sci-entificVisualization, Time-Varying Data, 
Wide-Area Network 



17 Virtual people & scalable worlds: Efficient compression and delivery of stored motion | 

data for avatar animation in resource constrained devices 
^ Siddhartha Chattopadhyay, Suchendra M. Bhandarkar, Kang Li 

November 2005 Proceedings of the ACM symposium on Virtual reality software and 
technology VRST '05 

Publisher: ACM Press " 1 

Full text available: | S| pdf(537.78 KB) Additional Information: full citation , abstract , references , index terms 

Animation of Virtual Humans (avatars) is done typically using motion data files that are 
stored on a client or streaming motion data from a server. Several modern applications 
require avatar animation in mobile networked virtual environments comprising of power 
constrained clients such as PDAs, Pocket-PCs and notebook PCs operating in battery 
mode. These applications call for efficient compression of the motion animation data in 
order to conserve network bandwidth, and save power at the client s ... 

Keywords: avatar animation, distributed virtual reality, human motion 
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18 VLSI architecture for lossless compression of medical images using the discrete §|| 
wavelet transform 

I. Urriza, J. I. Artigas, J. I. Garcia, L. A. Barragan, D. Navarro 

February 1998 Proceedings of the conference on Design, automation and test in 
Europe 

Publisher: IEEE Computer Society 

Full text available: fa pdf(58.57 KB) j 

JsT Additional Information: full citation , abstract , references , index terms 

Publisher Site 

This paper presents a VLSI Architecture to implement the forward and inverse 2-D 
Discrete Wavelet Transform (FDWT/IDWT), to compress medical images for storage and 
retrieval. Lossless compression is usually required in the medical image field. The word 
length required for lossless compression makes too expensive the area cost of the 
architectures that appear in the literature. Thus, there is a clear need for designing an 
architecture to implement the lossless compression of medical images using ... 

Keywords: Medical Image compression, VLSI architectures, DWT 1 

19 Progressive lossless compression of arbitrary simplicial complexes 
Pierre-Marie Gandoin, Olivier Devillers 

July 2002 ACM Transactions on Graphics (TOG) , Proceedings of the 29th annual 

conference on Computer graphics and interactive techniques SZGGRAPH 
'02, Volume 21 Issue 3 
Publisher: ACM Press 

! 

Full text available: fiQ pdf(8.88 MB) Additional Information: full citation , abstract , references , citings , index 
' ™ terms 1 ; 

Efficient algorithms for compressing geometric data have been widely developed in the 
recent years, but they are mainly designed for closed polyhedral surfaces which are 
manifold or "nearly manifold". We propose here a progressive geometry compression 
scheme which can handle manifold models as well as "triangle soups" and 3D tetrahedral 
meshes. The method is lossless when the decompression is complete.which is extremely 
important in some domains such as medical or finite element.Wh ... 

i. 

_ Keywords: coding, interactivity, mesh compression, non manifold meshes, progressivity 



20 Session P2: large data sets: Interactive rendering of large volume data sets 
Stefan Guthe, Michael Wand, Julius Gonser, Wolfgang StraBer 
October 2002 Proceedings of the conference on Visualization '02 
Publisher: IEEE Computer Society 

Full text available- S odf(3 21 MB) Additional Information: full citation , abstract , references , citings , index 
" terms 

We present a new algorithm for rendering very large volume data sets; at interactive 
framerates on standard PC hardware. The algorithm accepts scalar data sampled on a 
regular grid as input. The input data is converted into a compressed hierarchical wavelet 
representation in a preprocessing step. During rendering, the wavelet representation is 
decompressed on-the-fly and rendered using hardware texture mapping. The level of 
detail used for rendering is adapted to the local frequency spectrum oft ... 

Keywords: compression algorithms, level of detail algorithms, scientific visualization, 
volume rendering, wavelets ... . • 
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Lossless data compression 

From Wikipedia, the free encyclopedia 

Lossless data compression is a class of data compression algorithms that allows the exact original data to be 
reconstructed from the compressed data. This can be contrasted to lossy data compression, which does not allow 
the exact original data to be reconstructed from the compressed data. 

Lossless data compression is used in many applications. For example, it is used in the popular ZIP file format and 
in the Unix tool gzip. It is also often used as a component within lossy data compression technologies. 

Lossless compression is used when it is important that the original and the decompressed data be identical, or 
when no assumption can be made on whether certain deviation is uncritical. Typical examples are executable 
programs and source code. Some image file formats, notably PNG, use only lossless compression, while others 
like TIFF and MNG may use either lossless or lossy methods. GIF uses a lossless compression method, but most 
GIF implementations are incapable of representing full color, so they quantize the image (often with dithering) to 
256 or fewer colors before encoding as GIF. Color quantization is a lossy process, but the quantized image can be 
re-quantized with no further loss. (Some rare GIF implementations make multiple passes over an image, adding 
255 new colors on each pass.) 
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Lossless compression techniques 

Lossless compression methods may be categorized according to the type of data they are designed to compress. 
The three main types of targets for compression algorithms are text, images, and sound. Whilst, in principle, any 
general-purpose lossless compression algorithm (general-purpose means that they can handle all binary input) can 
be used on any type of data, many are unable to achieve significant compression on data that is not of the form 
that they are designed to deal with. Sound data, for instance, cannot be compressed well with conventional text 
compression algorithms. 

Most lossless compression programs use two different kinds of algorithms: one which generates a statistical 
model for the input data, and another which maps the input data to bit strings using this model in such a way that 
"probable" (e.g. frequently encountered) data will produce shorter output than "improbable" data. Often, only the 
former algorithm is named, while the latter is implied (through common use, standardization etc.) or unspecified. 

Statistical modeling algorithms for text (or text-like binary data such as executables) include: 

■ Burrows- Wheeler transform (block sorting preprocessing that makes compression more efficient) 

■ LZ77 (used by DEFLATE) 
m LZW 
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Encoding algorithms to produce bit sequences are: 

■ Huffman coding (also used by DEFLATE) 

■ Arithmetic coding 

Many of these methods are implemented in open-source and proprietary tools, particularly LZW and its variants. 
Some algorithms are patented in the USA and other countries and their legal usage requires licensing by the 
patent holder. Because of patents on certain kinds of LZW compression, and in particular licensing practices by 
patent holder Unisys that many developers considered abusive, some open source activists encouraged people to 
avoid using the Graphics Interchange Format (GIF) for compressing image files in favor of Portable Network 
Graphics PNG, which combines the LZ77-based deflate algorithm with a selection of domain-specific prediction 
filters. However, the patents on LZW have now expired. [1] (http://www.unisys.com/about unisys/lzw). 

Many of the lossless compression techniques used for text also work reasonably well for indexed images, but 
there are other techniques that do not work for typical text that are useful for some images (particularly simple 
bitmaps), and other techniques that take advantage of the specific characteristics of images (such as the common 
phenomenon of contiguous 2-D areas of similar tones, and the fact that colour images usually have a 
preponderance to a limited range of colours out of those representable in the colour space). 

As mentioned previously, lossless sound compression is a somewhat specialised area. Lossless sound 
compression algorithms can take advantage of the repeating patterns shown by the wave-like nature of the data - 
essentially using models to predict the "next" value and encoding the (hopefully small) difference between the 
expected value and the actual data. If the difference between the predicted and the actual data (called the "error") 
tends to be small, then certain difference values (like 0, +1, -1 etc. on sample values) become very frequent, 
which can be exploited by encoding them in few output bits. 

It is sometimes beneficial to compress only the differences between two versions of a file (or, in video 
compression, of an image). This is called delta compression (from the Greek letter A which is commonly used in 
mathematics to denote a difference), but the term is typically only used if both versions are meaningful outside 
compression and decompression. For example, while the process of compressing the error in the above-mentioned 
lossless audio compression scheme could be described as delta compression from the approximated sound wave 
to the original sound wave, the approximated version of the sound wave is not meaningful in any other context. 

Lossless compression methods 



For a complete list, see Category :Lossless compression algorithms 
Audio compression 



■ Apple Lossless - ALAC (Apple Lossless Audio Codec) 

■ Direct Stream Transfer - DST 

■ Free Lossless Audio Codec - FLAC 

■ Meridian Lossless Packing - MLP 

■ Monkey's Audio - Monkey's Audio APE 

■ RealPlayer - RealAudio Lossless 

■ Shorten -SUN 

■ TTA - True Audio Lossless 

■ WavPack - WavPack lossless 

■ WMA Lossless - Windows Media Lossless 
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Graphic compression 

i 

■ ABO - Adaptive Binary Optimization 

■ GIF - (lossless, but contains a very limited number color range) 

■ PNG - Portable Network Graphics 

■ JPEG-LS - (lossless/near-lossless compression standard) 

■ JPEG 2000 - (includes lossless compression method, as proven by Sunil Kumar, Prof San Diego State 
University) 

■ JBIG2 - (lossless or lossy compression of B&W images) 

■ TIFF 

■ WMPhoto - (includes lossless compression method) 

■ Qbit Lossless Codec - Focuses on intra-frame (single-image) lossless compression 
Video compression 

■ Huffyuv 

■ SheerVideo 

■ CorePNG [2] (http://corepng.corecodec.org/) 

■ MSU Lossless Video Codec 

■ LCL [3] (http://translate.google.com/tran^ 
Denei%2F2837%2FLRC.htm&langpair^ 
8&prev=%2Flanguage_tools) 

■ Qbit Lossless Codec [4] (http://www.qbit.com/) 

■ Animation codec 

■ Lagarith 

m H.264/MPEG-4 AVC 

Lossless data compression must always make some files longer 

Lossless data compression algorithms cannot guarantee compression for all input data sets. In other words, for 
any (lossless) data compression algorithm, there will be an input data set that does not get smaller when processed 
by the algorithm. This is easily proven with elementary mathematics using a counting argument, as follows: 

■ Assume that each file is represented as a string of bits of some arbitrary length. 

■ Suppose that there is a compression algorithm that transforms every file into a distinct file which is no 
longer than the original file, and that at least one file will be compressed into something that is shorter than 
itself. 

■ Let Mbc the least number such that there is a file F with length A/bits that compresses to something 
shorter. Let N be the length (in bits) of the compressed version of F. 

■ Because N< Af, every file of length N keeps its size during compression. There are 2 N such files. Together 

with F, this makes 2 N + 1 files which all compress into one of the 2^,files of length N. 

u But 2^ is smaller than 2 N + 1, so by the pigeonhole principle there must be some file of length N which is 
simultaneously the output of the compression function on two different inputs. That file cannot be 
decompressed reliably (which of the two originals should that yield?), which contradicts the assumption 
that the algorithm was lossless. 

■ We must therefore conclude that our original hypothesis (that the compression function makes no file 
longer) is necessarily untrue. 

Any lossless compression algorithm that makes some files shorter must necessarily make some files longer, but it 
is not necessary that those files become very much longer. Most practical compression algorithms provide an 
"escape" facility that can turn off the normal coding for files that would become longer by being encoded. Then 
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the only increase in size is a few bits to tell the decoder that the normal coding has been turned off for the entire 
input. For example, deflate compressed files never need to grow by more than 5 bytes per 65,535 bytes of input. 

In fact, if we consider files of length N, if all files were equally probable, then for any lossless compression that 
reduces the size of some file, the expected length of a compressed file (averaged over all possible files of length 
N) must necessarily be greater than N. So if we know nothing about the properties of the data we are 
compressing, we might as well not compress it at all. A lossless compression algorithm is only useful when we 
are more likely to compress certain types of files than others; then the algorithm could be designed to compress 
those types of data better. . I . 

Thus, the main lesson from the argument is not that one risks big losses, but merely that one cannot always win. 
To choose an algorithm always means implicitly to select a subset of all files that will become usefully shorter. 
This is the theoretical reason why we need to have different compression algorithms for different kinds of files: 
there cannot be any algorithm that is good for all kinds of data. 

The "trick" that allows lossless compression algorithms, used on the type of data they was designed for, to 
consistently compress such files to a shorter form is that the files the algorithm are designed to act on all have 
some fQrm of easily-modeled redundancy that the algorithm is designed to remove, and thus belong to the subset 
of files that that algorithm can make shorter, whereas other files would not get compressed or even get bigger. 
Algorithms are generally quite specifically tuned to a particular type of file: for example, lossless audio 
compression programs do not work well on text files, and vice versa. 

In particular, files of random data cannot be consistently compressed by any conceivable lossless data 
compression algorithm: indeed, this result is used to define the concept of randomness in algorithmic complexity 
theory. 

■ ■ • • • . i ■ . . 

See also 

■ Audio data compression 

■ David A. Huffman 

■ Information entropy 

■ Kolmogorov complexity ; ; 

■ Lossless Transform Audio Compression (LTAC) 

■ Lossy data compression 

■ List of codecs 

External links 

■ Lossless data compression Benchmarks and Tests (http://www.maximumcompression.com/) 

■ Comparison of Lossless Audio Compressors (http://wiki.hydrogenaudio.org/index.php? 
titIe=Lossless_comparison) at Hydrogenaudio Wiki 

■ Comparing lossless and lossy audio formats for music archiving 
(http://www.bobulous.org.uk/misc/audioFormats.html) 

■ Comparison of Lossless Video Codecs 
(http://www.compression.ru/video/codec_comparison/lossless_codecs_en.html) 

■ Links to data compression topics and tutorials (http://datacompression.info/) 

■ Catalog of lossless compression sites (http://www.compression-links.info/Lossless) 

Retrieved from "http://en.wikipedia.org/wiki/Lossless_data_compression" 
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LZ77 and LZ78 

From Wikipedia, the free encyclopedia 
(Redirected from LZ77 and LZ78 (algorithms)) 

LZ77 and LZ78 are the names for the two lossless data compression algorithms published in papers by Abraham 
Lempel and Jacob Ziv in 1977 and 1978. These two algorithms form the basis for most of the LZ variations 
including LZW, LZSS and others. They are both dictionary coders, unlike minimum redundancy coders or run 
length coders. LZ77 is the "sliding window" compression algorithm, which was later shown to be equivalent to 
the explicit dictionary technique first given in LZ78. 
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■ 3 References 
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LZ77 



LZ77 algorithms achieve compression by replacing portions of the data with references to matching data that has 
already passed through both encoder and decoder. A match is encoded by a pair of numbers called a length- 
distance pair, which is equivalent to the statement "each of the next length characters is equal to the character 
exactly distance characters behind it in the uncompressed stream." (The "distance" is sometimes called the 
"offset" instead.) 

The encoder and decoder must both keep track of some amount of the most recent data, such as the last 2 KB, 4 
KB, or 32 KB. The structure this data is held in is called a sliding window, which is why LZ77 is sometimes 
called sliding window compression. The encoder needs to keep this data to look for matches, and the decoder 
needs to keep this data to interpret the matches the encoder refers to. This is why the encoder can use a smaller 
size sliding window than the decoder, but not vice-versa. 

Many documents which talk about LZ77 algorithms describe a length-distance pair as a command to "copy" data 
from the sliding window: "Go back distance characters in the buffer and copy length characters, starting from that 
point." While those used to imperative programming may find this model intuitive, it may also make it hard to 
understand a feature of LZ77 encoding: namely, that it is not only acceptable but frequently useful to have a 
length-distance pair where the length actually exceeds the distance. As a copy command, this is puzzling: "Go 
back one character in the buffer and copy seven characters, starting from that point." How can seven characters be 
copied from the buffer when only one of the specified characters is actually in the buffer? Looking at a length- 
distance pair as a statement of identity, however, clarifies the confusion: each of the next seven characters is 
identical to the character that comes one before it. This means that each character can be determined by looking 
back in the buffer — even if the character looked back to was not in the buffer when the decoding of the current 
pair began. Since by definition a pair like this will be repeating a sequence of distance characters multiple times, 
it means that LZ77 incorporates a flexible and easy form of run-length encoding. 

Even though all LZ77 algorithms work by definition on the same basic principle, they can vary widely in how 
they output their encoded data — what values are possible for lengths and distances, for example, } and how length- 
distance pairs are distinguished from literals (single characters encoded as themselves, rather than as part of a 
length-distance pair.) A few examples: 
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■ The algorithm illustrated in Lempel and Ziv's original 1977 paper output all its data three values at a time: 
the length and distance of the longest match found in the buffer, and the literal which followed that match. 
If two successive characters in the input stream could only be encoded as literals, the length would be 0. 

■ In the PalmDoc format, a length-distance pair is always encoded by a two-byte sequence. Of the 16 bits 
that make up these two bytes, 1 1 bits go to encoding the distance, 3 go to encoding the length, and the 
remaining two are used to make sure the decoder can identify the first byte as the beginning of such a two- 
byte sequence. 

■ As of 2004, the most popular LZ77 based compression method is called DEFLATE; it combines LZ77 
with Huffman coding. Literals, lengths, and a symbol to indicate the end of the current block of data are all 
placed together into one alphabet. Distances can be safely placed into a separate alphabet; since a distance 
only occurs just after a length, it cannot be mistaken for another kind of symbol or vice-versa. 

LZ78 

While the LZ77 algorithm works on past data, the LZ78 algorithm attempts to work on future data. It does this by 
forward scanning the input buffer and matching it against a dictionary it maintains. It will scan into the buffer 
until it cannot find a match in the dictionary. At this point it will output the location of the word in the dictionary, 
if one is available, the match length and the character that caused a match failure. The resulting word is then 
added to the dictionary. 

Though initially popular, the popularity of LZ78 later dampened, possibly because for the first few decades after 
it was introduced, parts of LZ78 were patent encumbered in the United States. The most popular form of LZ78 
compression was the LZW algorithm, a modification of the LZ78 algorithm made by Terry Welcjh. 

References 

■ Jacob Ziv and Abraham Lempel; A Universal Algorithm for Sequential Data Compression 
(http://ww.cs.duke.edu/courses/spring03/<^ 

IEEE Transactions on Information Theory, 23(3), pp337-343; May 1977. 

External links * 

■ List of LZ77 algorithm (and its derivatives) libraries, papers and sources (http://www.compression- 
links.info/LZSS) 
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